Two Layer Digital RAAM
نویسنده
چکیده
We present modifications to Recursive Auto-Associative Memory which increase its robustness and storage capacity. This is done by introducing an extra layer to the compressor and reconstructor networks, employing integer rather than realvalued representations, pre-conditioning the weights and presetting the representations to be compatible with them, and using a quick-prop modification. Initial studies have shown this method to be reliable for data sets with up to three hundred subtrees.
منابع مشابه
Scaling Connectionist Compositional Representations
The Recursive Auto-Associative Memory (RAAM) has come to dominate connectionist investigations into representing compositional structure. Although an adequate model when dealing with limited data, the capacity of RAAM to scale-up to real-world tasks has been frequently questioned. RAAM networks are difficult to train (due to the moving target effect) and as such training times can be lengthy. I...
متن کاملRAAM for Infinite Context-Free Languages
With its ability to represent variable sized trees in xed width patterns,RAAM is a bridge between connectionist and symbolic systems. In the past, due to limitations in our understanding, its development plateaued. By examining RAAM from a dynamical systems perspective we overcomemost of the problems that previously plagued it. In fact, using a dynamical systems analysis we can now prove that n...
متن کاملEncoding Labeled Graphs by Labeling RAAM
In this paper we propose an extension to the RAAM by Pollack. This extension, the Labeling RAAM (LRAAM), can encode labeled graphs with cycles by representing pointers explicitly. Data encoded in an LRAAM can be accessed by pointer as well as by content. Direct access by content can be achieved by transforming the encoder network of the LRAAM into an analog Hopfield network with hidden units. D...
متن کاملLabeling Raam
In this paper we propose an extension of the Recursive Auto-Associative Memory (RAAM) by Pollack. This extension, the Labeling RAAM (LRAAM), is able to encode labeled graphs with cycles by representing pointers explicitly. A theoretical analysis of the constraints imposed on the weights by the learning task under the hypothesis of perfect learning and linear output units is presented. Cycles an...
متن کاملParticipation and performance trends in ultracycling
BACKGROUND Participation and performance trends have been investigated in ultramarathons and ultratriathlons but not in ultracycling. The aim of the present study was to investigate (1) participation and performance trends in ultraendurance cyclists, (2) changes in cycling speed over the years, and (3) the age of the fastest male and female ultraendurance cyclists. METHODS Participation and p...
متن کامل